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Abstract 

The  method  of  Bayesian  statistical  inference  is  used  to 
derive  estimates  of  operational  parameters  in  a  simple  system  that  can 
be  in  one  of  two  states:  failed,  or  operative.  The  sampling  plan 
consists  of  occasional  observations  of  the  system  for  finite  periods: 
snapshop,  plus  patch  sampling.  Numerical  examples  are  given. 
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I.  Introduction 

In  investigations  in  the  area  of  systems  reliability  it  is  often 
appropriate  to  consider  systems  which  alternate  between  two  capacility 
states,  up  or  down,  according  to  some  random  process.  One  measure  of 
effectiveness  that  is  of  importance  in  such  systems  is  the  long-run 

probability  that  the  system  will  be  up  or  productive  when  needed;  the 
latter  is  equivalent  to  the  long-run  fraction  of  the  time  during  which 
the  system  is  productive.  This  parameter  is  also  known  in  the  literature 
as  the  long-run  availability  or  the  operational  readiness  of  the  system, 
but  these  terms  are  not  standardized.  The  problem  of  estimation  of  the 
above  availability  parameter  received  some  consideration  in  a  recent 
paper  [4]>  where  the  authors  pointed  out  that  operator  log-book  data  on 
field  operations  of  systems  may  be  untrustworthy  and  suggested  some 
sampling  procedures  for  obtaining  supplementary  estimates  of  the  system 
parameters.  These  sampling  plans  yield  the  following  two  types  of 
observations  on  the  system:  a)  those  which  reveal  only  the  state  of  the 
system  at  isolated  time-points,  and  b)  those  which  continuously  record 


the  durai 


vuis 


ion  of  the  uo  and  dcv/n  times  of  the  system  throughout  inter 
of  fixed  or  random  length.  Cox  [2]  has  considered  a  similar  sampling 
plan  for  a  problem  in  computer  acceptance  testing. 

The  papers  [2]  and  [4]  use  the  method  of  maximum  likelihood 
to  obtain  estimates  of  the  system  parameters  from  the  two  combined 
sources  of  data.  Frequently,  however,  prior  information  about  the 
system  parameters  is  .available  and  is  based  on  experience  with  previous 
or  current  systems  of  a  similar  kind.  A  strong  impetus  to  use  this 
information  often  exists.  Frequently  it  is  incorporated  informally  by 
engineers  who  are  familiar  with  particular  systems.  But  there  may  exist 
merit  in  carrying  out  a  more  formal  analysis  by  expressing  at  least 
some  of  the  additional  information  in  the  form  of  prior  distributions 
for  system  parameters,  and  applying  the  technique  of  Bayesian  inference. 

In  this  paper  such  analysis  is  provided  for  a  particular  class  of  sampling 
plans,  with  the  objective  of  estimating  the  long-run  system  availability. 

Since  the  maximum  likelihood  estimates  are  not  guaranteed  to 
possess  any  desirable  optimal  properties  in  the  non- asymptotic  case, 
we  believe  that  it  will  bo  useful  to  investigate  other  estimates  which 
have  known  properties  in  the  usual  small  sample  situation,  Tne  Bayes 
estimates  are,  formally  speaking,  optimum  with  respect  to  the  assumed 
prior  distributions  and  loss  structure;  in  addition  they  offer  one- 
plausible  way  for  combining  the  above  two  sources  of  data,  provided  the 
underlying  model  remains  approximately  valid.  The  fact  that  some  of 

m 

these  estimates  appear  to  improve  upon  the  maximum  likelihood  estimates 
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in  particular  cases  investigated  (see  Section  V)  offers  heuristic 
justification  for  proposing  these  estimates. 

In  Section  II  a  description  of  our  sampling  procedure  and  of 
the  system  model  is  given.  In  Section  III  mathematical  expressions 
for  the  Bayes  estimates  are  derived  using  the  assumptions  stated  in 
Section  II.  It  turns  out  that  these  estimates  can  be  represented  in 
explicit  forms  for  a. special  case  of  the  sampling  plan;  these  are 
obtained  in  Section  IV.  Finally,  in  Section  V  some  illustrative 
numerical  comparisons  are  give.-*  for  different  estimates  obtained  in 
this  paper. 


II.  Assumptions 


A.  Description  of  tho  System  Mode) 

We  assume  that  the  times  spent  in  the  U£  and  down  states  are 
mutually  statistically  independent;  both  up  and  down  times  have  the 
exponential  distribution.  Specifically,  if  and  are  the  i-th  up 
and  down  times,  then  their  densities  are  given  by 


(1) 

fy(x)  =  Xe'Xx 

[x  >  0] 

(2) 

fD(y)  -  ^e"^Y 

[y  >  0] 

where  X  and  p  are  unknown  positive  parameters.  Thus  the  system  is 
described  by  a  two-state  renewal  process  (see  Cox  [ 1 ] ) .  The  assumption 
of  exponential  density  for  the  u£  and  down  times  is  made  here  because 
it  has  been  found  to  represent,  at  least  approximately,  a  large  variety 
of  empirical  failure  and  repair  time  distributions  and  because  of  its 
attractive  mathematical  properties. 

Using  (l)  and  (2)  it  can  be  shown  that  the  probability  of 
finding  the  system  in  the  ug  state  a  long  time  after  it  has  been  put 
into  operation  is  given  by 

(3)  p  =  P[up  in  the  long  run]  =  ^ 

so  that 

(4)  <1  =  1-p  =  P{down  in  the  long  run]  =  . 

Suppose  that  observations  are  made  at  widely  spaced  instants,  meaning 

t 

that  prior  knowledge  is  utilized  to  assure  that  the  sampling  interval 
is  greater  than,  say,  5(X+pr*.  Then  the  states  observed  are 
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effectively  independent,  and  the  probability  that  the  system  is  observed 
to  be  up  is  p. 


B.  Sampling  Procedure 

Following  [2]  and  [4],  we  consider  sampling  procedures  which 
yield  the  following  two  types  of  information  on  the  system: 

(a)  A  sequence  of  "snapshot"  observations,  which  are  available  only 
at  widely  dispersed  instants.  These  snapshots  merely  reveal  whether 

the  system  is  ug  or  down  at  the  instant  when  the  observation  is  made. 

(b)  A  sequence  of  continuous  observations  on  the  u£  and  down  times 
of  the  system  throughout  intervals  of  fixed  or  random  duration.  Follow¬ 
ing  the  terminology  of  [4]>  these  observations  will  be  called  "patches". 
Some  examples  of  patch  observations  are  given  below. 

When  the  exponential  distribution  holds  and  snapshots  are  made 
at  random  instants,  it  is  the  time  remaining  in  a  given  state  after  the 
snapshot  has  been  made  (rather  than  the  total  time  in  the  state,  before 
and  after  the  observation)  that  follows  the  exponential  law  with  the 
parameter  appropriate  to  the  state  observed;  intuitively  this  is  because 
long  times  in  state  tend  to  be  observed,  but  renewal  theory  mathematics 
provides  a  proof.  Thus  under  the  exponential  assumption  we  can  consider 
sampling  plans,  e.g.,  Case  II  below,  where  observations  are  not  made 
for  the  complete  lengths  of  the  up  and  down  times. 

We  now  define  the  quantities  which  arise  in  the  above  sampling 

t 

procedure  and  develop  notations  for  them. 
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a:  total  number  of  ug  intervals  observed  during  patches. 

x+:  total  up  time  observed;  x+  =  Ij.  x^,  x^  being  an  individual 
up  interval  (or  forward  recurrence  time), 
bj  total  number  of  down  intervals  observed  during  patches; 

b  may  be  fixed  or  random  depending  on  the  sampling  plan. 

y+:  total  down  time  observed;  y+  =  y^y^  being  an  individual 

down  interval  (or  forward  recurrence  time), 
o:  total  number  of  snapshots  showing  the  system  to  be  U£ 

p:  total  number  of  snapshots  showing  the  system  to  be  down 

It  follows  from  the  above  description  that  the  likelihood 
function  of  the  observations  following  the  above  sampling  procedure 
will  be  given  by 

(5)  L(X,  p)  =  e  Ve  "V  (j^)  (}--)  . 

A  number  of  alternative  sampling  plans  are  special  cases  of  the  general 
procedure  described  above.  Two  examples  appear  below. 
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Case  I 

A  system’s  up  and  down  history  is  continuously  recorded 
through  k  cycles,  each  consisting  of  one  up  period  and  one  down  period, 
(possibly  during  the  developmental  phase  of  the  system).  Thereafter  m 
rare  snapshots  are  taken,  r  of  which  show  the  system  to  be  up.  In  this 
case 

a  =  b  =  k 
a  =  r;  f  =  m  -  r. 

Case  II 

A  system  is  observed  m  times  at  rare  intervals,  and  each  time 
the  system  state  and  the  remaining  time  in  that  state  are  recorded.  If 
r  is  the  number  of  snapshots  showing  the  system  to  be  up,  then 
a  =  a  =  r 
b  =  P  =  m  -  r 

C.  A  Priori  Distribution 

We  assume  next  that  X  and  p.  have  independent  priors  belonging 
to  the  gamma  family: 

(6)  fx(\)  =  Y(c,S;X)  =  SV'1  e'a  (X  >  0) 
and 

(7)  f2(p)  =  r(d,T|;p)  =  nV-V^  (p  >  0) 

Containing  (5),. (6)  and  (7),  we  obtain  the  posterior  density 
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(8) 


Lp(X,|i) 


In  the  above,  c,  K,  d  and  (3  are  assumed  to  be  known  positive  constants 
which  will  perhaps  be  estimated  from  the  prior  data  available  about  the 
distributions  of  \  and  p.  In  the  case  when  there  is  no  prior  information 
we  shall  put  c  =  d=  l,5  =  fl  =  0«  It  is  seen  from  (8)  that  for  these 
values  of  the  parameters,  the  modified  likelihood  function  Lp(\,p) 
reduces  to  L(\,p)  as  defined  in  (5).  The  prior  distributions  have 
been  assumed  to  belong  to  the  gamma  family  since  the  latter  is 
conjugate  to  the  exponential  distribution. 

D.  Loss  Functions 

Let  &  denote  an  estimate  of  long-run  system  availability,  p. 

The  loss  L(&,  p)  from  estimating  b  when,  in  fact,  p  prevails  may  be 
specified  in  various  ways.  In  general  the  loss  should  increase 
as  the  difference  between  6  and  p  increases,  but  the 
loss  associated  with  a  negative  error  may  not  be  the  same  as  that 


=  L(X,|i)f1(lt)  f2(\) 


associated  with  a  positive  error  of  equal  magnitude.  The  loss 
functions  to  be  used  here,  however,  will  be  symmetrical}  they  are 
all  related  to  the  familiar  mean  squared  error 

(9)  L(&,  p)  =  C(p)(6-p)2  . 

We  shall  first  consider  the  loss  function  which  is  the  unweighted  mean 
squared  error 

(10)  1^(6,  p)  =  C(6  -  p)2  . 

where  C  is  a  positive  constant. 

It  seems  clear,  however,  that  when  estimating  a  probability 
the  importance  of  an  error  of  the  magnitude  e  =  J&  -  p(  may  not  be 
independent  of  the  probability  level;  an  error  of  0.1  may  be  of  more 
importance  at  p  =  0.05  or  0.95  than  at  0.5*  If  so,  the  loss  function 
(9)  with  C(p)  =  C[p(l-p)]_1  reflects  this  qualitative  condition  and 
leads  to  the  following  loss  function: 

(11)  L2(6,  p)  =  (b  -  p)2, 

C  again  being  a  positive  constant. 

Still  another  criterion  for  estimating  a  probability,  super¬ 
ficially  plausible  when  p  is  large,  is  that  the  fractional  (per  cent) 
error  of  the  estimate  be  minimized.  This  leads  to  C(p)  =  p  and  the 
loss  function 

(13)  L3(6,  p)  =  C(£  -  if'  . 
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This  paper  is  devoted  to  obtaining  Bayes  estimates  with 
respect  to  the  above  loss  functions,  which  are  all  variations  on  the 
mean-squared  error  theme.  In  specific  instances  other  loss  functions 
may  well  occur,  and  the  estimates  implied  must  be  constructed  anew.  It 
is  perhaps  worth  mentioning  that  the  point  estimation  problem  that 
concerns  us  here  is  by  no  means  the  only  relevant,  nor  even  the  most 
important,  statistical  question  likely  to  arise  in  practice.  For 
instance,  one  may  wish  to  provide  confidence  limits  fox  the  unknown 
readiness  parameter  on  the  basis  of  sample  information,  or, 
alternatively,  to  test  the  hypothesis  that  one  system  is  an  improvement 
upon  another.  Such  problems  are  not  considered  here. 


In  this  section  we  derive  formal  expressions  for  the  Bayes 


estimates  of  the  measure  of  effectiveness  under  patch- snapshot  sampling 
for  the  system  model  we  have  described  above. 

Let  &*,  6*  and  be  the  Bayes  estimates  with  respect  to  the 
loss  functions  L^,  L2,  L^  when  the  prior  distributions  of  X  and  p,  are 
given  by  (6)  and  (7)  respectively.  In  terms  of  the  posterior  distribu¬ 
tion  of  p  the  estimates  corresponding  to  L^,  L^,  and  I.._,  are  respectively 

(14)  b*  =  E(p)  , 


(15) 


JL(i-p)'1]  - 
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and 

(16)  6*  =  , 

3  E[p-2] 

Notice  first  that  if  the  sampling  plan  is  simply  to  take  m 
snapshots,  r  of  which  find  the  system  up,  and  if  the  prior  distribution 
of  p  is  uniform,  then  6*  =  (r+l)(nr+2  while  =  r/m,  which  equals  the 
maximum  likelihood  estimate.  On  the  other  hand,  under  similar 
circumstances, 

for  r  =  0,  1 
for  r  =  2,  3,  ...»  m. 

If  the  prior  is  proportional  to  p,  however,  6^  =  r/nH-1. 

Since  the  Bayes  estimate  does  not  depend  on  the  order  in  which 

the  patch  and  snapshot  observations  have  been  taken  because  of  the 
exponential  assumption,  we  assume  without  any  loss  of  generality  that 
the  patch  observations  are  taken  first  and  then  followed  by  the  snap¬ 
shots.  Thus  under  the  above  assumption,  x+  and  y+  denote  respectively 
the  total  up  and  down  times  observed  in  a  sequence  of  (a+b)  successive 
observations.  It  now  follows  from  the  familiar  reproducibility  property 
of  the  gamma  prior  distributions  with  respect  to  exponential  distribu¬ 
tions  that  the  posterior  distribution  of  \  and  p  after  such  observations 
have  been  made  will  be  given  by  y(a+c,  l+x+;\)  and  y(b+d,  q+y+;  p) 
respectively;  [see  (6)]  .  Further,  the  posterior  distribution 

of  the  ratio  p  =  after  X^,  ...,  Xa,  Y^,  ...,  Y^  have  been 

* 

observed  can  be  shown  to  be  of  the  form 


•8  =  { 


r-1 

m 


11 


i,  >Kwvt.*<u.  -  v  r-ti  v hr  inT'll  ■  . .  i  ■iimn  in  mun  n  mm  m  iri-iirnnin<n>nT  ri7iiihiTiiittii|rirr)lT|B!Mtt 


(17) 


i  —  1 ,2, . . . ,a;  j— 1,2, 


.,b) 


_  r(a+b+c+d) 

=  JTi+cTfC^dT 


(t+x+)a+c(n+y+)bfrdPb^d-1Ci-p)a+c-1 


0  <  p  <  1 . 


Moreover,  after  (g+p)  snapshots  have  been  taken  which  result 
in  a  successes,  the  posterior  distribution  will  be 


(18) 


9<pIW"--V 


Yi»y2>--->Yb;a>P) 


> 


where 

(19)  h(P)  = 

0  <  p  <  1. 

Now  using  (14),  ( 15 ) ,  (16)  and  (l8)  we  finally  get  (see  [3])  that 


(20) 


#  _  B(ar+a+c+l ,  bt-p+d)  t  Ffa+bt-c+d,  a+e+c+1;  a+tH-o+p+c+dt-1;  z) 
1  B(a+a+c,  trt-p+'d)  F(a+bHc+d,  a+g+c;  a+bt-g+p+c+d;  z) 

b+g+d _  ^  F(a+b+c+d,  b+dHo+l;  a+b+g+p+c+dH ;  z) 

a+b^a+p+c+d  F(a+b*-c+d,  b+o+dj  a+b^g+p+c^d; z) 


(See  [3]) 

where  F( •,•;•;•)  is  a  hypergeometric  function^representable  as 


F(a,P;Y»z)  =  1  +  z  + 


g(a+l)p(p+l) 

l^-Yir*-!) 


2  a. 

z  + 


x++5-n-y+ 

vr- 


Similarly* 


(21) 


-  b+cH-a-1  _  F(a+bJc+d,  bHg+d;  afb+g+p-t-c+d-1;  z) 

2  a  t  b+c+dNtip-2  F'ta+h'c+d,  ltf-a+d-1;  a^  bt-a+p+c+d-2;  z) 
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and 

(22) 

However,  to  ensure  convergence  of  the  hypergeometric  series 
occurring  in  (20),  (21 )  and  (22),  we  require  that 

(23)  jz |  <  1, 
which  implies  that 

(24)  0  <  y+  +  n<  2(x++0. 

This  does  not  seem  too  severe  a  restriction  in  view  of  the  fact  that  for 
most  of  the  systems  in  practice,  p  will  be  near  1  and  therefore  with  a 
high  probability  the  total  -up  time-  in  a  given  situation  will  be  larger 

than  the  total  down  time  .  When  (24)  does  not  hold,  the  form  of  solution 

given  in  (20)-(22)  will  not  be  usable. 

We  thus  see  that  the  three  Bayes  estimates  we  have  considered 

can  all  be  expressed  as  products  of  the  quotient  of  two  hypergoemetric 

functions  and  a  simple  fraction.  In  general  it  will  not  be  possible  to 

simplify  the  above  expressions  further  and  reduce  them  to  a  more 

convenient  form.  However  an  equivalent  representation  in  terms  of 

continued  fractions  can  be  given.  We  notice  that  the  two  hypergoemetric 

series  associated  with  the  Bayes  estimate  are  of  the  form  F(-t,  ntf*l;  n+l;z) 

and  F^t,  m,  nj  z).  From  a  result  given  in  [3],  we  have 


jv  _  bfgJ-d-2 
3  a+b+c+d+a+p-2 


F(a-i-b+-c+dt  b<-a+d-l;  a+b+c+dHa+ft-l; z) 
F(a+b+c+d,  bfa+d-2j  a^  b+c+d+a+p-2;  z) 
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uftwirirtsicsamisufe. 


(25) 


F(-t,  nd-1;  nfl;  z) 
FfC^f  n;  z)  " 


1 


U1Z 


1  - 


Vl2 


1  - 


U2Z 


1  - 


V2Z 


f 


•  •  •  • 


where 

(26)  u 

s 


v 


6 


fo-s-l)(n  -rrrt-s-l) 
'n+2s-2)(n+2s-l) 


nT+-s)fr>-'t+s) 
,rrt2s-l){n+2s)  ’ 


s  =  1,  2, 


Thus  the  ratio  of  the  cwo  hypergeometric  functions  appearing  in  the 
expressions  for  the  Bayes  estimates  can  be  replaced  by  a  continued 
fraction;  there  seems  to  be  a  possibility  of  extracting  useful 
approximations  from  this  representation.  When  a  =  £  =  0(i.e.  no  shapshot 
information  is  used),  it  can  be  shown  that  =  0  in  the  continued 
fraction  expansions  for  the  Bayes  estimates  6j|  and  so  that  they  may 
be  represented  in  simple  explicit  forms  in  this  special  case.  In  this 
case  they  can,  however,  be  obtained  more  directly  and  because  of  the 
relative  case  with  which  they  can  be  evaluated,  the  direct  derivation 
of  these  estimates  under  patch-sampling  alone  is  given  in  the  following 
section. 


H 
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IV..  Bayes  Estimates  for  Long-Run  System  Availability.'under.  Patch  Sampling 
The  preceding  developments  have  yielded  the  formulae  (20),  (21 ) 
and  (22)  for  the  Bayes  estimates  of  the  system  availability,  p,  when 
patch  and  snapshot  information  is  available.  The  purpose  of  this 
section  is  to  show  that  when  patch  infromation  alone  is  utilized,  the 
Bayes  estimates  end  resulting  from  loss  functions  and  may 
be  presented  in  simple  explicit  forms. 

If  a  up  intervals  have  been  observed  having  total  uptime  x+, 


then  the  posterior  density  of  X  is  gamma 


Y1(c+a;?  +x+j  X)  =  e 


-(5+x+)X  x+)x] 


c+a-1 


rCc+a, 


tt+x+) 


and  similarly  the  posterior  density  of  p  is  the  independent  gamma 


Y2(Wd,  T)+y+;p)  =  e 


-(ti+y+)i*  tU+y+V] 


d+b-1 


T(b+d 


(n+y+)  . 


The  Estimate  b*  under  Patch  Sampling 

If  posterior  information  concerning  p  -■  is  contained  in 
(27)  and  (23)  then  we  may  rewrite  (15)  as  follows: 


cn  00 


6*  =  ~vt.~ y— 

2  00  CO 


l  l  (1+ “)tjY2  A# 

|  |  (1+  £)<»■  «.<* 


The  gamma  integrals  are  easily  evaluated,  and  we  obtain 


l  +  (i 


rx++r.) 


y++n  a+c-i 

o  4.  \f  ,  a+c  v  /  Y++T^  \ 

2  Y^+n  ^a+c-r  x.+5  b+d-l 


For  the  special  case  in  which  S  =  tj  =  0,  c  =  d  =  1  ("flat"  priors) 


b+1  -2 


~~  x2  +  2xy  +  ■—  y2  * 


where 


x  =  x^a  and  y  =  y^/b  .  As  a  and  b  become  large  (31 )  approaches 

the  maximum  likelihood  estimator  >  f°r  finite  a  and  b,  the  right 

x+y 

hand  side  of  (31 )  is  somewhat  larger  than  the  maximum  likelihood 
estimate  when  the  latter  exceeds  . 


The  Estimate  6*  under  Patch  Sampling 

The  form  of  the  estimate  may  be  found  in  exactly  the  same 
manner  as  was  used  to  obtain  .  From  (l6)  we  similarly  obtain 

1  +  («±c_)(Z±l!L) 

1  vx  H'Vd-l' 

(32)  62  = - 2 - 

i  +  5/j?±£  )  +  ( a+c )  ( a+c+1 )  ,  Y++n 

1  ^  x.+c  b+d-i  /  rv2  i>rd-iy(Fdrn  • 


1  +  +  (^c)(aT" 

V*  b+d'1  (>+  +  02 


V.  Numerical  Results 

The  estimates  we  have  obtained  above  are  optimum  when  it  is 
assumed  that  the  system  parameters  have  prior  distributions  given  by 
(6)  and  (7)  and  loss  functions  are  as  given  by  (lO),  (ll)  and  (12). 

It  is  however  of  considerable  importance  to  investigate  their 
performance  in  samples  of  realistic  sizes  when  the  actual  system 
samples  is  given  a  fixed  set  of  parameter  values.  Since  any  analytical 
results  appear  to  be  difficult  to  obtain  for  the  general  case,  we  carry 
out  the  investigation  by  means  of  experimental  sampling  for  a  specific 
system  involving  the  following  set  of  parameter  values: 

X  =  0.2  (expected  ug-time  of  5  units) 

i*  =  1  (expected  down-time  of  1  unit) 

The  particular  sampling  plan  used  is  that  of  Case  I  described  in 
Section  IIB.  The  following  parameters  are  chosen  for  the  sampling 
plan: 

k  =  ^(number  of  initial  periods  observed) 
m  =  10  (number  of  later  snapshots). 

A  synthetic  system  realization  is  observed  continuously  through  five 
consecutive  up-and-down  times,  after  which  merely  the  state  --  up  or 
down  —  is  noted;  snapshots  axe  taken  at  intervals  of  approximately  15 
time  units.  Altogether  five  hundred  such  sample  realizations  are 
examined.  From  the  data  for  each  realization  the  estimates  &*,  6*  and 
are  computed  using  (20),  (21 )  and  (22)  and  substituting  c  =  d  =  1; 

K  =  f|  =  0  (the  parameters  corresponding  tc  "flat"  prior  distribution) 
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in  the  above  expressions.  The  data  used  for  the  purpose  of  these 
investigations  are  the  same  as  reported  in  [4]  and  it  is  therefore 
possible  to  compare  the  maximum  likelihood  estimate  obtained  there 
with  the  above  Bayes  estimates.  In  addition,  the  estimates  are 
computed  using  merely  the  outcomes  of  the  k  =  5  initial  period 
observations,  omitting  the  snapshots.  A  summary  of  the  results 
(computed  from  500  independent  realizations)  showing  the  averages 
of  the  estimates  and  their  mean  squares  about  the  true  value  are 
given  in  Table  I.  The  last  row  in  this  table  gives  the  value  of 
the  Cramer-Rao  lower  bound  for  the  variance  of  the  unbiased  estimate 
of  p,  which  has  been  computed  from  the  formula  given  in  Lehmann  [5]. 
For  Case  1  of  the  sampling  plan,  this  lower  bound  is  given  by  the 
right  hand  side  of  the  following  inequality: 

02  >  2kp2(l-p)2 _ 

T  "  2k2+2k(m-2k)p(l-p)-(l-2p)2k2 

where  T  is  any  unbiased  estimate  of  p. 
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TABLE  1 

Estimates  of  Long  Run  Availability, 

X  »  1/  u  ■  0.2,  p  =  0.533>  5c  =  5»  m  =  10 
(The  Bayes  estimates  have  been  computed  with 
respect  to  "flat"  prior  distributions) 


1 


l  . 


Estimate 

Averages  ? 

Mean  Squares  1 

-- 

Patch-Snapshot 

Patch  only 

Patch-Snapshot 

Patch  only 

0.8155 

0.8017 

.005725 

.009735 

0.8353 

0.8288 

.005486 

•009497 

• 

0.8007 

0.7710 

.007778 

.017&9 

Maximum  Likelihood 

0.8223 

0.8154 

.005774 

.009745 

3ramer-Eao 

Lover  Bound 

— — 

— - 

.00*195 

.00774 

J 

i 

i  | 

i 

! . •  .  .  i 

i  « 

i 

[ 

i 

* 

;  i 


t  *  •  1  ' 


1  .'uii'l  c  nr-  i  r<  a.  m  .  hi  a-.*  ( ..  *  i  •  *  •  i  *  o\!.Y. 

C 


The  above  table  indicates  that  even  in  the  absence  of  a  priori 
information  the  estimates  6*  and  6#  are  perhaps  a  little  better  than  the 

maximum  likelihood  estimate  for  the  particular  set  of  parameter  values, 

i 

X  and  p,  assumed.  The  estimate  6^  seems  to  have  a  slight  edge  over  both 
6#  and  the  maximum  likelihood  estimate.  On  the  other  hand,  the  estimate 

(  j 

6*  appears  to  be  definitely  inferior  to  the  other  estimates.  In  view  of 
the  above  fact,  a  more  detailed  investigation  of  the  estimates  6j-  and 

6*  seems  to  be  warranted.  For  all  these  estimates,  patch-snapshot 

^  * 

I  ?  ' 


sampling  considerably  reduces  the  mean  square  errors  below  those 

!  I  ! 

obtained  from  patch  sampling  alone.  j  j 

If  there  exists  accurate  prior  information  about  the 

'  i  I 

distribution  of  system  parameters,  we  expect  that  the  mean  square  should 

I  ! 

be  reduced  considerably  by  incorporating  the  available  prior  information 

'  '  i 

in  our  estimates.  To  investigate  the  effect  of  this  reduction,  the 

(  i  j 

above  estimates  were  computed  with  respect  to  three  sets  of  gamma 

I  i  ! 

distributions  each  having  E(p)  =  1.0  and  E(\ )  =  0.2  for  one  hundred 

I  '  i 

sample  realizations  of  the  system  described  above.  The  mean  squares 

;  I  ; 

of  these  estimates  are  displayed  in  Table  2.  Columns  (l)  1. 

t 

and  (5)  of  the  table  give  the  results  coresponding  to  the  generalized 

t 

maximum  likelihood  estimates  obtained  by  maximizing  (S)  and  using  the 

i 

formulae  (2.8)  and  (2.9)  of  [4].  This  table  shows  that  reduction  of 

i  j 

the  mean  square  error  is  indeed  effected  by  using  the  above  set  of 

(  l 

priors,  as  is  to  be  anticipated.  This  table  indicates  that  is 
definitely  inferior  but  as  to  the  relative  efficacy  of  the  other  estimates, 

i 

Table  2  is  somewhat  uncertain.  Also  it  must  be  emphasized  that  only  one 
parameter  value,  p,  and  a  few  prior  distributions  were  considered. 

f.  !j<;  i  20  i  ! 

I 

I 

.  .  »  :•  t 

‘  •  *  ‘  I 

* 


Table  2 

Mean  Squares  of  Estimates  of  Lonq-Run 
Availability  Us ins  Prior  Information 

*  1,  X  s  0.2,  p  =  0.833,  k  «  5j  m  *  10 


• 

Patch-Snapshot 

. .  Patch 

Parameters 
of  the 

GMT.  5*  6*'  6| 

GML  6*  b*  b* 

4 

gamma  prior 
distributions 

(10  (2)  (3)  (4) 

(5)  (6)  (7)  (0) 

1.  c=0.2;d=2.0 

1*1. 0;  Tp2. 0 

.004214  .004309  .004340  .005763 

.006206  .006835  .006420  .01182 

2.  C=0.2;d-10.0 
i  1.0; tj— 10. 0 

.002973  .003236  .003194  .004193 

.003786  .004878  .O04o7o  i 00657; 

3.  c=10. 0;d=2. 0 
4=50.0;  n  2.0 

•  *  • 

I 

.002730  .002540  .002541  .003195 

.002994  .002922  .002808  .00425; 

1  ' 

i  ■  ! 

I  » 

i  J  1 

i  !  • 


VI.  Reference 


1.  D.  R.  Cox,  Renev/al  Theory,  Methuen  Monograph,  New  York:  John  Wiley 

&  Sons,  Inc.,  1962. 

2.  D.  R.  Cox,  "A  Mote  on  the  Analysis  of  a  Type  of  Reliability  Trial," 
SIAM  Journal  on  Applied  Mathematics,  Vol.  14  (1966),  pp.  1133-1142. 

3.  A.  Erdelyi,  et.  al.  Higher  Transcendental  Functions,  Eateman 
Manuscript  Project,  California  Institute  of  Technology,  New  York: 
McGraw-Hill  Book  Company,  Inc.  (1953). 

4.  D.  P.  Gaver,  M.  Mazumdar,  "Statistical  Estimates  in  a  Problem  of 
System  Reliability,"  Naval  Research  Logistics  Quarterly,  1967, 

Vol.  14»  pp.  473-488. 

5.  E.  L.  Lehmann,  Notes  on  the  Theory  of  Estimation  (Chaps.  1-5), 
University  of  California,  Berkeley,  4,  Calif,  (reprinted  1962). 

6.  H.  Raiffa  and  R.  Schaifer,  Applied  Statistical  Decision  Theory. 
Boston:  Harvard  University  Press  Cl96l). 


Unclassi fied 


•  DOCUMENT  CONTROL  Da7A  •  R  i  D 

(Security  etoKxitication  of  ttitc,  body  uf  abstract  and  indexing  ,1  nnotnti^n  n»u»*  be  or.tJud  iWu.v  the  o reporf  /a  claxalfled) 


I  ORIGIN*  TING  A*  Tl  Vt  T  V  (Corporate  author,  2«.  RfcPOhT  itii/Mi  I  »  CLASSIFICATION 

Graduate  School  of  Industrial  Administration  _  Undassi fied _ 

Carnegie-Mellcn  University  ib  “HOuP 

Not  applicable 


».  REPORT  1ITLP 

Some  Bayes  Estimates  of  Long-Run  Availability  in  a  Two-State  System 


4  Descriptive  notes  (Type  of  report  endJneluMve  daiev) 

Management  Science  Research  Report 


5  Au  THORlC ;  (Fithl  nem>  ,  middle  initio!,  tart  rone) 


May  1969 


D.  P.  Gaver  and  M.  Mazumdar 


6  REPORT  DATE 


May  29,  1969 


•  4.  CONTRACT  GRANT  NO 

NON*  /6U(24) 


6.  PFOJCC  T  NO 


NR  047-048 


10  DISTRIBUTION  STATEMENT 


74.  TOTAL  NO.  OF  PACES  I  lb.  NO.  OF  REFS 


64.  ORIGINATOR'S  REPORT  NUMBER(S) 


Management  Sciences  Research  Report  No.  161 


96.  OTHER  REPORT  NO(S)  (Any  other  number a  that  may  be  oatlgned 
thia  repnrt) 


Not  applicable 


Distribution  of  this  document  is  unlimited. 


II.  SUPPLEMENTARY  NOTES 


Not  applicable 


|T  3 .  AI'dHACT 


12.  SPONSORING  MlLI  TARY  ACTIVITY 


Logistics  and  Mathematical  Statistics  Br. 
Office  of  Naval  Research 
Washington,  D.  C.  20360 


hrhe  method  of  Bayesian  statistical  inference  is  used  to  derive  estimates 
of  operational  parameters  in  a  simple  system  that  can  be  in  one  of  two  states: 
failed,  or  operative.  The  sampling  plan  consists  of  occasional  observations 
of  the  system  for  finite  periods:  snapshop,  plus  patch  sampling.  Numerical 
examples  are  given. 


DD/r.,1473  <PAGt  n 


S/N  0101  *807-6131  1 


Unci assi fied _ 

Security  Classification 


i-3140C 


